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APPARATUS FOR STORING AND SEARCHING AUDIO/VIDEO 
DATA CONTAINING ADDITIONAL INFORMATION 

BACKGROUND OF THE INVENTION 



The present invention relates to a digital broadcasting reception system 
for receiving a digital broadcasting signal and storing and searching the 
same, and more particularly, to an apparatus for storing and searching 
audio/video data containing additional information in which a user stores 
audio/video data of a desired program together with the additional 
information corresponding to the program, resulting in easy and quick 
search. 

2. Description of the Related Art 

According to quick spread of digital media and development of a digital 
signal processing technology, a digital broadcasting service using a ground 
wave or a satellite are widely being spread. A general digital broadcasting 
service is realized on the basis of the MPEG (Moving Picture Experts 
Group) standard. To perform a digital broadcasting service according to the 
MPEG standard, program specific information (PSD such as audio/video 
information and program information which are compressed with respect to 
each broadcasting channel is transmitted in the form of a packet of a 
transport stream (TS). The MPEG TS packet is composed of 188 bytes, 
among which 4 bytes are header information, and 184 bytes are pay load 
information. The 4-byte header information includes packet identifier (PID) 
representing what each packet is. Also, the PSI packet transmitted in the 
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form of a TS packet has at least two tables. That is, one is a program 
map table (PMT) for identifying TS packets of basic streams such as a 
video stream, an audio stream or a data stream for each program 
constituting multiplexed programs and the other table is a program 
association table (PAT) for identifying the PMT. The PAT includes the 
PID such as a network information table (NIT), a service description table 
(SDT), a time data table (TDT) and the PMT. The NIT includes the PID 
such as an event information table (EIT). The SDT includes information 
with respect to a provider such as broadcasting station information, and the 
TDT includes information with respect to an absolute time of a broadcast 
program. The EIT includes information on an electronic program guide 
(EPG). The EPG information is information with respect to each program 
such as an edit time, a title, a content and a program classification of a 
corresponding program. Also, the PMT includes the PID with respect to an 
audio/video packet of a corresponding program. The audio/ video packet 
exists in the form of a packetized elementary stream (PES) generally, 
including a bitstream in which audio and video have been compressed. The 
header portion of the PES includes a clearance space in which user's 
private data can be inserted. In particular, a user data region is defined in 
a video bitstream, providing a syntax for allowing user desired information 
to be inserted thereinto. 

In a digital broadcasting service transmitted in the form of a TS 
packet, a packet including audio/video data of a corresponding program and 
all TS packets including a PSI packet should be stored in the form of a 
single program TS packet, in order to store particular audio/video data 
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contained in a particular packet. Also, in order to search the stored 
audio/video data, a process for decoding a single program TS packet should 
be performed, which will be described in more detail with reference to FIGs. 



FIG. 1A is a block diagram showing a general storage device for storing 
audio/video data. FIG. IB shows a pattern of a single program TS packet. 

In FIG. 1A, a TS decoder 11 receives a TS packet and classifies the 
received TS packet into various PSI packets such as a PAT, PMT, NIT and 
EIT. The classified PSI packet is stored in a storage medium 16 under the 
control of a controller 15. Also, the TS decoder 11 extracts a corresponding 
audio/video packet from the input TS packet, using PID information of the 
audio/video packet with respect to a user desired particular program. The 
extracted audio/video packet is supplied to an audio/video packet processor 
12. If the audio/video packet has been encrypted, the audio/video packet 
processor 12 decrypts the supplied audio/video packet using a decryptor 13, 
so as to be stored in a storage medium 16. The controller 15 reads the 
PSI packet stored in the storage medium 16 and a user selected audio/video 
packet so as to be output to a single program TS producer 14. The single 
program TS producer 14 produces a single program TS packet as shown in 
FIG. IB, using the audio/video packet of the user selected program and the 
PSI packet, which are input via the controller 15, and stores the same in 
the storage medium 16 again. Referring to FIG. IB, the single program TS 
packet includes all packets necessary for watching a user desired program. 
That is, the single program TS packet includes all PSI packets such as 
PAT, PMT, NIT, SDT, TDT and EIT packets necessary for a 
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corresponding audio/video packet as well as an audio packet and a video 
packet. 

FIG. 2 shows a general searching apparatus for searching audio/video 
data in which a stored single program TS packet is searched to allow a 
user to watch his or her desired program. 

In FIG. 2, a PAT parser 111 in a single program TS decoder 110 
receives a single program TS packet and searches a PAT packet. The 
PAT parser 111 detects PID information representing position of a PSI 
packet such as a PMT, SDT, TDT and NIT, and outputs each packet to 
each parser 112, 113, 114 or 115. The PMT parser 112 parses the PID 
information of the PMT packet input from the PAT parser 111 and outputs 
an audio/video packet to an audio/video decoder 17. Meanwhile, the NIT 
parser 113 extracts PID information of the EIT packet from the NIT packet 
and outputs the EIT packet to an EIT parser 116. The EIT parser 116, the 
SDT parser 114, and the TDT parser 115 read data of each packet 
according to the PID information of the parsed packet and outputs the read 
data to a search information comparator 18. The search information 
comparator 18 compares data of each packet supplied from each parser 114, 
115 or 116 with user input search information. Here, the search information 
includes a title, a content and a time of a user desired program. The 
search information comparator 18 outputs the comparison result to an 
audio/video decoder 17, in the case that data of each packet is coincident 
with user desired search information. Then, the audio/video decoder 17 
decodes a currently input audio/video packet and outputs the decoded result. 

However, the above prior art requires a storage medium of a large 
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capacity, since a PSI packet should be also stored in addition to an 
audio/video packet including audio/video data. Also, since data of the PSI 
packet stored together with the audio/video packet should be parsed in order 
to allow a user to search the stored audio/ video packet and to watch a user 
desired program, a long searching time is consumed. 

SUMMARY OF THE INVENTION 

To solve the above problems, it is an object of the present invention 
to provide an apparatus for storing and searching audio/video data including 
additional information, in which a transport stream (TS) packet is decoded 
and the additional information with respect to a user desired audio/video 
packet from a program specific information (PSI) packet is read, and then 
the additional information is inserted and stored into a particular region of 
the audio/video packet to thereafter be parsed and searched. 

To accomplish the above object of the present invention, there is 
provided an apparatus for storing audio/video data including additional 
information, the audio/video data storing apparatus comprising: a packet 
parser for extracting packet identification information from a program 
specific information (PSI) packet and outputting additional information 
corresponding to the extracted packet identification information and an audio 
and/or video packet; 

an audio/video parser for parsing an audio and/or video packet using 
the packet identification information and outputting an audio and/or video 
packet; an audio/video producer for inserting the additional information 
supplied from the packet parser into a particular region in the audio and/or 
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video packet supplied from the audio/video parser; a storage medium; and a 
controller for controlling each element so that the additional information is 
inserted into the audio and/or video packet so as to be stored in the storage 
medium. 

According to another aspect of the present invention, there is also 
provided an apparatus for searching audio/video data including additional 
information, the audio/video data searching apparatus comprising: an input 
portion for receiving an audio and/or video packet including additional 
information; an additional information classifier for parsing the audio and/or 
video packet supplied from the input portion and extracting and outputting 
the additional information, and then outputting the audio and/or video packet 
excepting for the additional information; an additional information parser 
comparing the additional information received from the additional information 
classifier with user search information and outputting a parsed result with 
respect to wether or not the search information is included in the additional 
information; an audio/video decoder for decoding an audio and/or video 
packet supplied from the additional information classifier according to the 
parsed result supplied from the additional information parser; and an output 
portion for outputting a decoded result supplied from the audio/video decoder 
and the additional information. 



The above object and other advantages of the present invention will 
become more apparent by describing the preferred embodiment thereof in 
more detail with reference to the accompanying drawings in which: 
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FIG. 1A is a block diagram showing a general storage apparatus for 
storing audio/video data; 

FIG. IB shows the pattern of a single program TS packet; 

FIG. 2 is a block diagram showing a general search apparatus for 
searching audio/video data; 

FIG. 3 is a block diagram showing an apparatus for storing audio/video 
data including additional information according to an embodiment of the 
present invention; 

FIG. 4 is a block diagram showing the TS parser in the FIG. 3 
apparatus in detail; 

FIG. 5 is a block diagram showing an apparatus for storing audio/video 
data including additional information according to another embodiment of the 
present invention; 

FIG. 6 is a block diagram showing an apparatus for searching 
audio/video data including additional information which is stored in FIG. 3; 

FIG. 7 shows an example of additional information according to the 
present invention; and 

FIG. 8 shows another example of additional information according to 
the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

Preferred embodiments of the present invention will be described with 
reference to the accompanying drawings. 

In FIG. 3, an apparatus for storing audio/video data including additional 
information according to an embodiment of the present invention, includes a 
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TS parser 31 for parsing a received TS packet, an audio/video parser 32 for 
parsing an audio/video packet resulting from the parsing of the TS packet, 
and a decryptor 33 connected to the audio/video parser 32, for decrypting an 
audio/video packet. An audio/video data producer 34 connected between the 
TS parser 31 and the audio/video parser 32 includes a header detector 341 
for detecting a header region from an input audio/video packet and an 
additional information inserter 342 for inserting the additional information 
resulting from the parsed result of the TS packet into the detected header 
region, to thereby produce new audio/video data. The FIG. 3 apparatus also 
includes a controller 35 for controlling the operation of each element so that 
audio/video data including the additional information is stored in the storage 
medium 36. 

The operation of the storage apparatus for storing the audio/video data 
including the additional information of FIG. 3 having the above constitution 
will be described below with reference to FIG. 4. 

FIG. 4 is a block diagram showing the TS parser 31 in the FIG. 3 
apparatus in detail. The TS parser 31 includes a PAT parser 311, a PMT 
parser 312, a NIT parser 313, a SDT parser 314 and a TDT parser 315. 
An EIT parser 316 is connected to the NIT parser 313. An audio packet 
parser 317 and a video packet processor 318 are connected to the PMT 
parser 312. 

The PAT parser 311 in the TS parser 31 receives a TS packet to 
search a PAT packet. The PAT parser 311 detects PID information 
representing position of a PSI packet such as a PMT, SDT, TDT and NIT, 
and outputs each packet to each parser 312, 313, 314 or 315. The PMT 
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parser 312 parses the PID information of the PMT packet input from the 
PAT parser 311 and outputs a corresponding audio/video packet to an audio 
packet processor 317 and a video packet processor 318, respectively. The 
audio packet processor 317 converts an audio packet into a packet 
elementary stream (PES) or an elementary stream (ES), and likewise the 
video packet processor 318 converts a video packet into a PES or ES, to 
then output the converted result to an audio/video parser 32. Hereinafter, 
an example in which the video packet is converted into a PES will be 
described. 

Meanwhile, the NIT parser 313 extracts PID information representing 
position of the EIT packet from the NIT packet and outputs the EIT packet 
to an EIT parser 316. The EIT parser 316, the SDT parser 314, and the 
TDT parser 315 parses each packet and outputs the additional information. 
Here, the additional information includes a title, classification code and time 
of audio/video data of a user desired program, which includes image feature 
information such as content information, energy information and motion 
information. Referring to FIGs. 7 and 8, the additional information will be 
described later. The produced additional information as described above is 
output to the additional information inserter 342. 

In FIG. 3, the audio/video parser 32 parses the input audio/video packet 
which has been converted into a PES in the TS parser 31, using the PID 
information. Here, the audio/video parser 32 decrypts the input audio/video 
packet using a decryptor 33 in the case that the input audio/video packet 
has been encrypted, and then outputs the decrypted result to the header 
detector 341 and the additional information inserter 342. The header 
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detector 341 receives the decrypted audio/video packet and parses a syntax, 
to thereby detect a PES header or a header with respect to user data to 
then be output to the additional information inserter 342. In the case of an 
ES, a user header is inserted into a region where user data can be inserted. 

Meanwhile, the additional information inserter 342 inserts the additional 
information input from the TS parser 31 into a PES header region or a user 
data region of the audio/video packet decrypted in the audio/video parser 32 
and outputs the inserted result to the controller 35. The controller 35 
controls the storage medium 36 to store the audio/video packet in which the 
additional information has been inserted. 

FIG. 5 is a block diagram showing an apparatus for storing audio/video 
data including additional information according to another embodiment of the 
present invention, in which only a video signal feature is parsed and user 
desired program information is inserted into the parsed result, to then be 
stored. 

The FIG. 5 apparatus includes a video encoder 51 for receiving a video 
signal and a video feature parser 52. Also, the FIG. 5 apparatus includes a 
program information inputter 54 for receiving a user desired program 
information and an additional information processor 53 connected to the 
program information inputter 54. The FIG. 5 apparatus also includes a 
multiplexer 55 connected to the video encoder 51 and the additional 
information processor 53, a controller 56 for controlling each element and a 
storage medium 57. 

In FIG. 5, the video encoder 51 compresses an input video signal to 
produce a video bitstream, and outputs a video packet converted into a PES to 
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the video feature parser 52 and the multiplexer 55. The video feature parser 
52 extracts a parameter which can represent a feature of the input video 
signal. Here, the parameter is an energy of the input video signal or motion 
information thereof. Meanwhile, the program information inputter 54 receives 
user desired program information to then be output to the additional 
information processor 53. Here, the program information includes a title, a 
classification code and a time of a corresponding program. The additional 
information processor 53 receives the program information input from the 
program information inputter 54 and the parameter extracted from the video 
feature parser 52, and disposes the received program information and 
parameter so as to match a syntax and outputs the additional information to 
the multiplexer 55. Here, the additional information includes a title, a 
classification code and a time of a user desired program, which is image 
feature information such as content information, energy information and 
motion information. The additional information will be described below with 
reference to FIGs. 7 and 8. The multiplexer 55 inserts the additional 
information input from the additional information processor 53 into a PES 
header region or user data region of the video packet input from the video 
encoder 51. In the case of an ES, a header with respect to a user is 
inserted into a region where user data can be inserted. The controller 56 
stores the video packet in which the additional information has been 
inserted, in the storage medium 57. 

FIG. 6 is a block diagram showing an apparatus for searching 
audio/video data including additional information which is stored in FIG. 3. 
Also, the FIG. 6 apparatus can be applied to a video packet including 
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additional information stored in FIG. 5. 

The FIG. 6 apparatus includes a storage medium 61 storing an 
audio/video packet including additional information, an inputter 62 for 
receiving the audio/video packet, a syntax parser 63 for parsing a syntax of 
the packet and detecting additional information, an additional information 
parser 64 for receiving the additional information detected in the syntax 
parser 63 and the search information, an audio/video decoder 65 for 
decoding the audio/video packet received from the syntax parser 63, and an 
outputter 66 for outputting the decoded result and the additional information 
parsed result. 

In FIG. 6, the storage medium 61 outputs an audio/video packet. The 
inputter 62 receives the audio/video packet from the storage medium 61 and 
outputs the same to the syntax parser 63. The syntax parser 63 parses the 
syntax of the audio/video packet of the PES and detects the additional 
information of the PES header or user data region. The syntax parser 63 
outputs the detected additional information to the additional information 
parser 64 and the audio/video packet except for the additional information to 
the audio/video decoder 65. The additional information parser 64 compares 
the input additional information with the user input search information. 
Here, the search information includes a title, a classification code and a time 
of a user desired program. Then, in the case that the search information is 
coincident with the additional information, the additional information parser 
64 outputs the comparison result to the audio/video decoder 65. Then, the 
audio/video decoder 65 decodes the audio/video packet supplied from the 
syntax parser 63 and outputs the decoded result to the outputter 66. The 
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outputter 66 outputs the audio/video decoded result supplied from the syntax 
parser 63 and the additional information parsed result supplied from the 
additional information parser 64. Here, the additional information includes a 
title, a classification code and a time of the audio/video data of a user 
desired program, which represents image feature information such as content 
information, energy information and motion information, which will be 
described with reference to FIGs. 7 and 8. 

FIG. 7 shows an example of additional information according to the 
present invention, in which additional information is added in a user data 
region. The user data header information is a header representing that 
following data is user data, which is represented with N bits. The 
additional information header is a header representing that following data 
includes additional information, which is represented with NO bits. The time 
information represents a time of a recorder or producer for corresponding 
audio/video data, which is represented with Nl bits. Also, the title 
information represents a title of corresponding audio/video data, which is 
represented with N2 bits. Also, the content information represents a content 
of audio/video data, which is represented with N3 bits. The content 
information also includes a key word which can represent a content of 
corresponding audio/video data. FIG. 8 shows another example of additional 
information according to the present invention, in which energy information 
representing a complexity of an image and motion information representing 
a degree of motion. 

Thus, the present invention extracts additional information, inserts the 
extracted additional information into a particular region, and stores resultant 
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audio/video data. As a result, the present invention can reduce a capacity 
of a storage medium which is used for storing user desired audio/video 
data. Also, the present invention searches the stored audio/video data using 
additional information included in a particular region, to thereby provide an 
effect of enhancing a searching speed. 
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